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Abstract 

Background: Pyrethroid insecticide-treated bed nets (ITNs) help contribute to reducing malaria deaths in Africa, but their 
efficacy is threatened by insecticide resistance in some malaria mosquito vectors. We therefore assessed the evidence that 
resistance is attenuating the effect of ITNs on entomological outcomes. 

Methods and Findings: We included laboratory and field studies of African malaria vectors that measured resistance at the 
time of the study and used World Health Organization-recommended impregnation regimens. We reported mosquito 
mortality, blood feeding, induced exophily (premature exit of mosquitoes from the hut), deterrence, time to 50% or 95% 
knock-down, and percentage knock-down at 60 min. Publications were searched from 1 January 1980 to 31 December 2013 
using MEDLINE, Cochrane Central Register of Controlled Trials, Science Citation Index Expanded, Social Sciences Citation 
Index, African Index Medicus, and CAB Abstracts. We stratified studies into three levels of insecticide resistance, and ITNs 
were compared with untreated bed nets (UTNs) using the risk difference (RD). Heterogeneity was explored visually and 
statistically. Included were 36 laboratory and 24 field studies, reported in 25 records. Studies tested and reported resistance 
inconsistently. Based on the meta-analytic results, the difference in mosquito mortality risk for ITNs compared to UTNs was 
lower in higher resistance categories. However, mortality risk was significantly higher for ITNs compared to UTNs regardless 
of resistance. For cone tests: low resistance, risk difference (RD) 0.86 (95% CI 0.72 to 1 .01 ); moderate resistance, RD 0.71 (95% 
CI 0.53 to 0.88); high resistance, RD 0.56 (95% CI 0.17 to 0.95). For tunnel tests: low resistance, RD 0.74 (95% CI 0.61 to 0.87); 
moderate resistance, RD 0.50 (95% CI 0.40 to 0.60); high resistance, RD 0.39 (95% CI 0.24 to 0.54). For hut studies: low 
resistance, RD 0.56 (95% CI 0.43 to 0.68); moderate resistance, RD 0.39 (95% CI 0.16 to 0.61); high resistance, RD 0.35 (95% CI 
0.27 to 0.43). However, with the exception of the moderate resistance category for tunnel tests, there was extremely high 
heterogeneity across studies in each resistance category (chi-squared test, p<0.00001, I 2 varied from 95% to 100%). 

Conclusions: This meta-analysis found that ITNs are more effective than UTNs regardless of resistance. There appears to be 
a relationship between resistance and the RD for mosquito mortality in laboratory and field studies. However, the 
substantive heterogeneity in the studies' results and design may mask the true relationship between resistance and the RD, 
and the results need to be interpreted with caution. Our analysis suggests the potential for cumulative meta-analysis in 
entomological trials, but further field research in this area will require specialists in the field to work together to improve the 
quality of trials, and to standardise designs, assessment, and reporting of both resistance and entomological outcomes. 
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Introduction 

The World Health Organization (WHO) estimates that there 
were 655,000 malaria deaths in 2010, with 86% occurring in 
children under 5 y [1]. Malaria deaths are declining with the 
massive scaling up of control measures, of which insecticide- 
treated bed nets (ITNs) are a major component. ITNs reduce 
deaths in children [2] and provide personal protection to the user, 
and at scale they provide community-wide protection by reducing 
the number of infective mosquitoes in the vicinity where ITNs are 
used [3,4]. Between 2008 and 2010, 254 million ITNs were 
supplied to countries in sub-Saharan Africa, and the proportion of 
African households in possession of a net rose from 3% in 2000 to 

Box 1. Types of Studies Included 
Cone Test 

Methods: Studies in the laboratory in which mosquitoes 
are placed inside a plastic cone that is attached to a net for 
three minutes; after net exposure the mosquitoes are 
placed in a holding container while entomological 
outcomes are measured [25]. 

Outcomes: Mosquito mortality after 24 h, percentage 
knock-down at 60 min, and time to 50% or 95% knock-down. 
Advantages: Researchers can standardise confounding 
variables, such as mosquito species, sex, age, and blood 
feeding status. The number of mosquitoes used in the test 
is standardised. 

Tunnel Test 

Methods: Studies in a laboratory, using animal bait, such as 
a guinea pig, placed at one end of a specially constructed 
tunnel. A fixed number of mosquitoes are released at the 
other end of the tunnel, and they must pass through a 
holed ITN or UTN to reach the animal bait. The following 
morning, both live and dead mosquitoes, blood fed and 
non-blood fed, are collected and counted from both sides 
of the holed net. Live mosquitoes are monitored for a 
further 24 h to assess delayed mortality [25]. 
Outcomes: Deterrence (not passed through net), blood 
feeding, and mosquito mortality. 
Advantages: As for cone test. 

Field Trials 

Methods: Studies in areas where mosquitoes breed. 
Volunteers sleep in experimental huts for a specific period 
under an ITN or an UTN, with one hut per person. The huts 
are identical in construction, and incorporate exit traps to 
catch wild mosquitoes entering and exiting the hut 
prematurely. Each morning of the trial, both live and dead 
mosquitoes, blood fed and non-blood fed, are collected 
and counted from both inside the hut and the exit traps. 
Live mosquitoes are monitored for a further 24 h to assess 
delayed mortality. Volunteers and nets are randomly 
allocated to huts at the start of the trial and are usually 
rotated to avoid bias. Often huts are cleaned between 
rotations to avoid cross-contamination of huts from the 
different treatment arms [25]. 

Outcomes: Deterrence, blood feeding, mosquito mortal- 
ity, and induced exophily. 

Advantages: Given that this method assesses the 
response of wild mosquitoes to human volunteers, it is a 
more realistic representation of how effective ITNs are in 
terms of entomological outcomes, compared with labora- 
tory methods. 



50% by 2010 [5]. Nets, when in good condition and used 
correctiy, are effective, simple to use, easy to deliver to rural 
communities, and cost-effective when used in highly endemic 
malarious areas [6] . On account of their low mammalian toxicity, 
speed of action, and high insecticidal activity, pyrethroids [7] are 
the only insecticide class recommended by the WHO for use in 
ITNs [8]. ITNs are effective with the African vectors Anopheles 
gambiae s.s. and An. funestus in part because these species are 
endophagic (feed indoors) and endophilic (rest indoors after 
feeding). Aside from their insecticidal activity, pyrethroids also 
exert an excito-repellency effect, which can lead to fewer 
mosquitoes entering a home (deterrence) where ITNs are used, 
or can cause disrupted blood feeding and premature exit of 
mosquitoes from the home (induced exophily) [9] . Because of the 
excito-repellency property of ITNs, these nets retain their personal 
protection properties for users even after the nets become holed 
[10]. 

The emergence and spread of insecticide resistance to all four 
classes of public health insecticides (pyrethroids, organochlorines, 
organophosphates, and carbamates) threatens the effectiveness of 
ITNs and indoor residual house spraying. Currently, 27 countries 
in sub-Saharan Africa have reported pyrethroid resistance in 
Anopheles vectors [11]. The real figure could very well be higher, as 
a lack of in-country resistance monitoring prevents accurate 
assessment. Because of their pyrethroid dependency, ITNs are 
especially vulnerable to insecticide resistance, as unlike indoor 
residual house spraying there are no readily available alternative 
insecticides. To prevent amplifying pyrethroid resistance, the 
WHO recommends that pyrethroid insecticides should not be used 
for indoor residual house spraying in areas with high long-lasting 
insecticide-treated bed net (LLIN) coverage [1]. In a recent study 
the extensive deployment and use of LLINs was blamed in part for 
selecting resistance in Anopheles vectors in Senegal, where malaria 
morbidity also increased [12]. The threat of resistance has led the 
WHO and members of the Roll Back Malaria Partnership to 
produce the "Global Plan for Insecticide Resistance Management 
in Malaria Vectors", which stresses the urgency with which this 
problem needs to be addressed [13]. 

Insecticide resistance takes multiple forms: target-site resistance, 
metabolic resistance, and cuticular resistance. Target-site resis- 
tance to pyrethroids in An. gambiae and An. arabiensis is underpinned 
by a non-silent point mutation (either L1014F or L1014S) in the 
sodium channel gene, which is referred to as the knock-down 
resistance (kdr) genotype [14,15]. Target-site resistance prevents 
the successful binding of the insecticide molecule to sodium 
channels on the nerve membranes. Metabolic resistance is caused 
by the activity of three large multi- gene families (cytochrome 
P450s, glutathione transferases, and carboxylesterases) that are 
able to metabolise or sequester the insecticide, thereby preventing 
it from reaching its target [16]. It is becoming clear that the 
cytochrome P450s are responsible for the majority of cases of 
metabolic resistance, with a secondary role for the glutathione 
transferases [17-20]. There is also preliminary evidence that 
cuticular resistance may be a contributing factor, but this aspect 
requires further analysis [17,18,21]. As pyrethroids and the 
organochlorine insecticide DDT target the sodium channel 
protein, cross-resistance to both insecticides is common. There is 
evidence that phenotypic resistance and kdr frequency have 
increased following the introduction of ITNs in some areas 
[22,23], which could nullify the effectiveness of ITNs [24]. 

Policy makers and researchers debate whether these various 
forms of resistance are having an impact on the effectiveness of 
ITNs in malaria control. We carried out a systematic review of all 
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relevant studies on human outcomes, but it became clear very 
quickly that there was an almost total absence of evidence to draw 
any conclusions on the impact of pyrethroid resistance on the 
efficacy of nets in decreasing disease transmission. So we turned to 
entomological studies: evidence of an effect of resistance on 
mosquitoes could be indicative of resistance having an impac on 
disease transmission. Our objective is to assess the effects of 
insecticide resistance in African anopheline mosquitoes on ITNs in 
terms of entomological outcomes in precise laboratory assays (cone 
tests), in laboratory tests with animals (tunnel tests), and in field 
trials with human volunteers as the attractants. 

Methods 

Inclusion Criteria 

Study design. We included laboratory tests (cone tests and 
tunnel tests) and field trials using experimental huts (see Box 1 for 
details of types of studies included). 

Mosquito population. Included African malaria vectors 
were An. gambiae, An. arabiensis, or An. junestus. We included 
laboratory studies that used established laboratory-colonised 
strains of mosquitoes with known resistance phenotype or 
genotype. Experimental hut study trials were included if they 
measured the resistance status of the wild mosquito populations at 
the time of the study by bioassays with our without kdr genotyping. 

Intervention. We included studies that compared an ITN 
(conventionally treated bed net [CTN] or a LLIN) versus an 
untreated bed net (UTN). The CTNs (which require dipping into 
insecticide and which also require retreatment at least once a year) 
must have been impregnated with a WHO-recommended 
pyrethroid with the recommended formulation and dose (see 
Table 1 for recommended impregnation regimens). The LLINs 
(which are factory-treated nets where the insecticide is incorpo- 
rated within or bound around the net fibres) must have had either 
interim or full recommendation from the WHO (see Table 2 for 
recommended LLINs). 

Outcomes. Included outcomes were blood feeding, mosquito 
mortality, deterrence (reduction in the number of mosquitoes 
found in experimental huts), induced exophily (number of 
mosquitoes found in the exit trap of experimental huts), not 
passed though net (measure of deterrence in tunnel test), percent 
knock-down at 60 min, time to 50% knock-down, and time to 
95% knock-down [25] (Table 3). 



Table 1. WHO-recommended pyrethroids for treatment of 
CTNs for vector control. 



Pyrethroid 


Formulation 


Dosage" 


Alpha-cypermethrin 


SC 10% 


20-40 


Cyfluthrin 


EW 5% 


50 


Deltamethrin 


SC 1%; WT 25%; WT 25%+binderK-o b 


15-25 


Etofenprox 


EW 1 0% 


200 


Lambda-cyhalothrin 


CS 2.5% 


10-15 


Permethrin 


EC 10% 


200-500 



a Milligrams of active ingredient per square metre of netting. 
b K-OTab 1-2-3. 

CS, capsule suspension; EC, emulsifiable concentrate; EW, emulsion, oil in water; 
SC, suspension concentrate; WT, water dispersible tablet. 
doi:10.1371/journal.pmed.1001619.t001 



Box 2. Considerations for Experimental Hut 
Study Design and Reporting 

Resistance Testing of Mosquito Populations: 
Reporting Information Required 

• Phenotypic resistance: doses of insecticide tested, 
exposure times to insecticide, total number of mosqui- 
toes tested, total number of mosquitoes killed 

• Target-site resistance: type of mutation screened for (i.e., 
L1014F or L104S), associated kdr allele frequencies 

• Metabolic resistance: identification of genes or enzyme 
class implicated in conferring resistance 

Study Design Reporting Criteria: Reporting 
Requirement 

• Study start date: date 

• Study duration: number of nights 

• Mosquito species present at location: species name and 
molecular form 

• Nets randomly allocated to huts at start of trial: yes or no 

• Nets rotated between huts during trial: yes or no 

• Sleepers rotated between huts during trial: yes or no 

• Washing of nets: wash procedure provided 

• Huts cleaned between rotations: yes or no 

• Observers collecting mosquitoes blinded to intervention: 
yes or no 

• Sleepers blinded to intervention: yes or no 

• Male mosquitoes used in the analysis: excluded or 
included 

• Raw data for measured outcomes: provided 

• Raw data for UTNs: provided 

Search Strategy 

The search period was from 1 January 1980 to 17 May 2013 or 
later. We searched the following databases for relevant studies: 
MEDLINE (from 1 January 1980 to 31 December 2013) and 
Cochrane Central Register of Controlled Trials, Science Citation 
Index Expanded, Social Sciences Citation Index, African Index 
Medicus, and CAB Abstracts (from 1 January 1980 to 17 May 
2013). There was no language restriction (see Table SI for the 
search terms used). 

We also searched the following conference proceedings: First 
MTM Pan-African Malaria Conference, Senegal, 6-9 January 
1997; Second MIM Pan-African Malaria Conference, South 
Africa, 15-19 March 1999; Third MIM Pan-African Malaria 
Conference, Tanzania, 1 7-22 November 2002; Fourth MIM Pan- 
African Malaria Conference, Cameroon, 13-18 November 2005; 
Fifth MIM Pan-African Malaria Conference, Nairobi, 2-6 
November 2009; American Society of Tropical Medicine and 
Hygiene 59th Annual Meeting, Atlanta, Georgia, 3-7 November 
2010; American Society of Tropical Medicine and Hygiene 60th 
Annual Meeting, Philadelphia, Pennsylvania, 4-8 December 
2011; and American Society of Tropical Medicine and Hygiene 
61 st Annual Meeting, Atlanta, Georgia, 11-15 November 2012. 

Study Selection 

Two authors (C. S. and A. A. E.) independendy screened the 
search results for potentially relevant studies and retrieved the 
corresponding full articles. C. S. and A. A. E. independendy 
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Table 2. WHO-recommended LLINs for vector control. 



Product Name 


Product Type 




Status of WHO Recommendation 


DawaPlus 2.0 


Deltamethrin coated on polyester 




Interim 


Duranet 


Alpha-cypermethrin incorporated into polyethylene 




Interim 


Interceptor 


Alpha-cypermethrin coated on polyester 




Full 


LifeNet 


Deltamethrin incorporated into polypropylene 




Interim 


MAGNet 


Alpha-cypermethrin incorporated into polyethylene 




Interim 


Netprotect 


Deltamethrin incorporated into polypropylene 




Interim 


Olyset 


Permethrin incorporated into polypropylene 




Full 


OlysetPlus 


Permethrin and piperonyl butoxide incorporated into polyethylene 




Interim 


PermaNet 2.0 


Deltamethrin coated on polyester 




Full 


PermaNet 2.5 


Deltamethrin coated on polyester with strengthened border 




Interim 


PermaNet 3.0 


Combination: deltamethrin coated on polyester with strengthened borde 
and deltamethrin and piperonyl butoxide incorporated into polyethylene 


(side panels) 
(roof) 


Interim 


Royal Sentry 


Alpha-cypermethrin incorporated into polyethylene 




Interim 


Yorkool LN 


Deltamethrin coated on polyester 




Full 



doi:10.1371/joumal.pmed.1001619.t002 



assessed the articles for eligibility using a standardised form (Table 
S2). Discrepancies between the eligibility results were resolved by 
discussion. Study investigators were contacted for clarification if 
the eligibility of a particular study was unclear. Multiple 
publications from the same study were identified, and if eligible, 
the original study was taken forward for inclusion. 



Data Extraction 

C. S. and A. A. E. independently extracted data from all 
included studies into a data extraction form. Missing or unclear 
outcome data were requested from the study investigators. For 
dichotomous outcomes for the ITN and UTN groups, the number 
of mosquitoes experiencing the outcome and the total number of 



Table 3. Measured outcomes appropriate for the different types of study. 



Field Method: 

Outcome Description Laboratory Methods Experimental Hut Trial 

Cone Test Tunnel Test 



Blood feeding 


A measure of the number of mosquitoes that have fed within a 

hut or in a tunnel during a lab test. Indicates how effective an 

ITN is in protecting the person sleeping under it (personal protection). 








Mosquito mortality 


Measured as the number of mosquitoes killed following exposure 
to an ITN or UTN, either immediate death or delayed death (24 h 
following exposure). Measured as a proportion of the total 
number of mosquitoes found within a hut or placed in 
tunnel/cone during a lab test. Indicates how effective an ITN 
is at directly killing mosquitoes. 


J 


J 




Induced exophily 


Measured as the proportion of mosquitoes found in exit traps, 
which indicates an attempt to prematurely exit the hut. 
Indicates how effective an ITN is in protecting the person 
sleeping under the net (personal protection). 






J 


Deterrence 


A reduction in the number of mosquitoes entering a hut using 
an ITN relative to the number of mosquitoes found in a control 
hut using an UTN. Indicates how effective an ITN is in protecting 
the person sleeping under the net (personal protection). 






J 


Not pass through net 


Equivalent to deterrence in hut trials; measured as the number 
of mosquitoes that do not pass through a holed ITN to reach 
an animal bait relative to an UTN in a control test. Indicates 
the potential effectiveness an ITN could have in protecting the 
person sleeping under the net. 




J 




Knock-down at 60 min 


The number of mosquitoes that are knocked down (the inability of 
a mosquito to fly or stand) within 60 min following exposure to a 
net. 








Time to 50% knock-down 


The time taken to knock down 50% of mosquitoes used in the test. 


! 

V 






Time to 95% knock-down 


The time taken to knock down 95% of mosquitoes used in the test. 









doi:10.1371/journal.pmed.1001619.t003 
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Table 4. Stratification of mosquito resistance constructed for this study based on either percent mortality from WHO bioassay 
data and/or kdr frequency. 





Resistance Status 


Percent Bioassay Mortality 


kdr Frequency (Percent) 


High 


<25 (low mortality) 


>80 (high kdr) 




<25 (low mortality) 


<25 (low kdr) 


Moderate 


25-80 (moderate mortality) 


25-80 (moderate kdr) 




25-80 (moderate mortality) 


<25 (low kdr) 


Low 


>80 (high mortality) 


<25 (low kdr) 


Unclear 


<25 (low mortality) 


<25 (low kdr) 



doi:10.1371/journal.pmed.1001619.t004 



mosquitoes were extracted (Tables S3-S5). For continuous 
outcomes, we extracted the mean and standard deviation when 
possible. For deterrence, the total number of mosquitoes was 
extracted for the ITN and UTN groups. A sub-sample of 10% of 
the studies was randomly selected to assess the performance of the 
duplicate extraction processes by C. S. and A. A. E. Differences 
between the two extraction processes were examined, and no 
serious discrepancies were found. The data extracted by C. S. 
were used in all analyses. 

Stratification of Resistance 

The WHO classifies mosquitoes as susceptible to insecticides if, 
after exposure to a diagnostic dose, there is £98% mortality, and 
as resistant to insecticides if there is ^90% mortality; mortality 
between 97% and 90% requires the confirmation of resistance 
genes for mosquitoes to be classified as resistant [26] . Character- 
isation of resistance across studies was not consistent, as some 
studies used bioassays, others used kdr genotyping, and some used 
a combination of both. We therefore developed a composite 
classification system to allow us to categorise the insecticide 
resistance status of mosquitoes in three broad groups (low, 
moderate, and high), based on phenotypic resistance measured 
using bioassay mortality data and/ or kdr frequency (Table 4). The 
alleles for kdr are presented as a frequency or percentage. 

Risk of Bias Assessment 

C. S. assessed the risk of bias of each included study. We 
developed a quality assessment tool that used four criteria for 
tunnel and cone tests: (1) comparability of mosquitoes in ITN and 
UTN groups (all female, age matched, and non-blood fed), (2) 
observers blinded, (3) complete outcome data, and (4) raw data 
reported for ITN and UTN groups. 

For experimental hut trials we developed seven criteria: (1) 
comparability of mosquitoes in ITN and UTN huts, (2) collectors 
blinded, (3) sleepers blinded, (4) raw data reported for ITN and 
UTN groups, (5) ITNs randomly allocated to huts, (6) ITNs 
rotated, and (7) sleepers rotated. For all criteria, we made a 
judgement of high, low, or unclear risk of bias. 

For hut trials, we generated an additional set of variables to 
assess variability in the design and execution of the studies, called 
"rigor of implementation". The criteria assessed included (1) nets 
being washed according to WHO protocol, (2) cleaning of huts 
before the trial and between rotations to avoid cross-contamina- 
tion of huts from the different treatment arms and to remove any 
insects that may have been missed during collections, (3) whether 
ITNs were tested either chemically or using bioassays to assess the 
insecticide impregnation efficacy and residual activity (applicable 
to CTNs), and (4) whether male mosquitoes were excluded from 



the analysis. We also reported how each study measured resistance 
in the wild mosquito populations: whether phenotypic resistance 
was measured by bioassays and/or kdr genotyping (and the 
number of mosquito screened for kdr), and whether metabolic 
resistance was measured. 

Data Analysis 

Analyses were carried out in Review Manager 5. We stratified 
the analyses by study design and the resistance status of the 
mosquito population (Table 4). Dichotomous outcomes were 
summarised using the RD; therefore, results are generalisable only 
to situations where the UTN group event rate is comparable to 
those observed here. When the same study compared multiple 
ITNs, the event rate in the UTN group was split to ensure each 
mosquito was included in the analysis only once. 

The results of studies were pooled using meta-analysis when 
possible. DerSimonian and Laird random effects models were used 
when heterogeneity was detected; otherwise, a fixed effects 
Mantel-Haenszel method was applied. It is worth noting that a 
random effects meta-analysis awards more weight to smaller 
studies than a fixed effects meta-analysis, and the weights for each 
study tend to equality as the between-trial variance increases. 

Assessment of Heterogeneity 

Data that could not be presented in forest plots were tabulated. 
Heterogeneity was assessed by visually inspecting the forest plots to 
detect overlapping confidence intervals, applying the chi-squared 
test with a j!>-value of 0.10 used to indicate statistical significance, 
and implementing the I 2 test statistic, with a value of 50% 
indicating a moderate level of heterogeneity. Of course, such 
assessments of heterogeneity are influenced by the number of 
included studies and should be interpreted with caution. 

Heterogeneity was substantive and common in all the analyses, 
and we sought explanations through a variety of pre-specified 
subgroup analyses. Subgroups included net type, type and 
concentration of insecticide, and whether the net was washed or 
not. We carried out sensitivity analyses by examining the effects 
when analyses were restricted to hut trials that had a low risk of 
bias (i.e., ITNs randomly allocated to huts, ITNs rotated, sleepers 
rotated). Reporting biases were explored using funnel plots. We 
calculated the confidence intervals for the r statistic using the 
method described in [27]. 

Results 

Search Results 

Figure 1 displays the review profile. Database searches 
recovered 1,107 records, from which three duplicates were 
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Records identified 
through database 
searching 
(n= 990) 



Additional records 
identified through 
other sources 
(n= 0) 



Records after duplicates 

removed 

(n = 3) 



Studies included in 
qualitative synthesis 
(n = 19 records 
describing 49 separate 
studies) 



Studies included in 
quantitative synthesis 
(meta-analysis) 
(n=60 separate studies) 



Records screened by the 


title and abstract 


(n = 987 ) 








Full-text articles assessed 


for eligibility 




(n= 64) 





Full-text articles excluded with reasons 
(n=45) 

n= 10 Resistance not characterised at time of the 
study 

n= 15 Study does not involve African Anopheline 
mosquitoes 

n= 6 Village trial which did not include a UTN as a 
control arm 

n= 6 non-WHO recommended net used 
n=l Review article 

n= 3 Village trial using nets which had been in use for 
a number of years therefore data not comparable 

n=l Nets stored for 5 years post use before being 
screened therefore data not comparable with other 
studies 

n=l The effect of temperature on net efficacy 
measured therefore data not comparable with other 
studies 

n=l Data replicated in a previous study 



Figure 1. Flow diagram of the study selection process. 

doi:10.1371/journal.pmed.1001619.g001 

removed. Searching other sources did not yield any potentially 
relevant records. After screening the 1,104 records, 914 records 
were excluded. Of the remaining 73 records, 55 records were 
excluded (see Figure 1 for exclusion reasons). The remaining 25 
records [4,6,9,28-49] described 60 separate studies (a study is 
defined as a comparison that has a distinct control UTN arm). 



Results of 53 of the 60 studies were combined in a meta-analysis; 
the results of five studies are described in Tables 5 and 6; and two 
studies did not report useable data. 

The updated MEDLINE search (May-December 2013) recov- 
ered 29 1 records, of which two records were assessed for eligibility. 
They were subsequendy excluded for not meeting the study design 
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inclusion criteria and for not characterising resistance in the 
mosquito populations at the time of the study. 

Characteristics of Included Studies 

The 60 included studies included cone tests in — 25), tunnel tests 
(n= 11), and experimental hut trials (n = 24). 

Cone tests. The 25 included cone test studies made 60 
comparisons. Characteristics for each comparison are given in 
Table 7. UTNs were compared against unwashed and washed 
CTNs and LLINs. 

Fifty-seven comparisons used An. gambiae s.s. mosquitoes, whilst 
three were of An. arabien.su. Overall, 29 comparisons used 
laboratory-reared mosquito strains (Kisumu, VKPR, OC-Lab, 
KWA, and RSP strains), and 28 comparisons used wild field- 
caught mosquitoes from Yaokoffrkro (Cote d'lvoire), Muheza 
(Tanzania), and localities in Uganda. Three comparisons used 
recently colonised An. ambiensis mosquitoes that were originally 
collected from the Ulanga District of Tanzania. 

Based on the reported WHO bioassay percent mortalities and 
kdr frequencies, 28 comparisons were carried out with mosquitoes 
with low resistance, 20 comparisons with moderately resistant 
mosquitoes, and 1 1 comparisons with highly resistant mosquitoes; 
resistance was unclear for one comparison. Only one comparison 
measured metabolic resistance. 

For the risk of bias assessment, all comparisons reported 
comparability of ITN and UTN mosquito groups, but it was 
unclear in all studies whether observers were blinded (Table S6). 
No comparison reported incomplete outcome data. Fifteen 
comparisons reported raw data for ITN and UTN groups, the 
remaining 45 did not. 

Tunnel tests. The 1 1 included tunnel test studies made 20 
comparisons. UTNs were compared against unwashed CTNs and 
LLINs. Characteristics for each comparison are given in Table 8. 
All comparisons used An. gambiae mosquitoes (the number of 
mosquitoes used varied from 200 to 592). Three comparisons used 
wild field-caught mosquitoes from Yaokoffrkro (Cote d'lvoire) and 
Muheza (Tanzania) in their assessment, whilst 17 comparisons 
used laboratory-reared mosquito strains (Kisumu, VKPR, Ki- 
sumu/VKPR hybrids, Tola, and Kou strains). Based on the 
reported WHO bioassay percent mortalities and kdr frequencies, 
12 comparisons were carried out with mosquitoes with low 
resistance, six comparisons used highly resistant mosquitoes, and 
resistance was moderate for two comparisons. No comparison 
measured metabolic resistance. 

For the risk of bias assessment, 16 comparisons reported 
comparability of ITN and UTN mosquito groups, whilst 
comparability was unclear in four comparisons (Table S7). It 
was unclear in all studies whether observers were blinded. No 
comparison reported incomplete outcome data. Sixteen compar- 
isons reported raw data for ITN and UTN groups, the remaining 
four did not. 

Experimental hut field trials. The 24 included hut studies 
made 56 comparisons (Table 9). 20 comparisons used field sites in 
Cote D'lvoire, 14 in Tanzania, 1 1 in Benin, six in Burkina Faso, 
and five in Cameroon. Most comparisons (41 of 56) were of^4n. 
gambiae mosquitoes, 12 were oiAn. arabiensis, and three were of^4n. 
funestus. Two comparisons used laboratory-reared strains (Kisumu). 
Based on the reported WHO bioassay percent mortalities and kdr 
frequencies, 26 comparisons were carried out with mosquitoes 
with low resistance, 21 comparisons used highly resistant 
mosquitoes, and resistance was moderate for nine comparisons. 
Two comparisons measured metabolic resistance. 

For the risk of bias assessment, no comparisons reported 
comparability of ITN and UTN mosquito groups or blinded 



12 



March 2014 | Volume 11 | Issue 3 | e1 001 61 9 



Impact of Pyrethroid Resistance on ITN Efficacy 



O 

■D 



% a. 



u X 



i? Si 



0 o 



o £ 



c 








thr 


LA 


c 


c 


E ^ 


d 


JZ 

al 


_c 

QJ 


S 8 




E 


E 


T3 


thr 


pet 


pei 


00% ( 
.05%), 


serine 


00% ( 
.75%) 


00% ( 
.75%) 


i- o 




«- O 


<— o 



EE EE £E EE 



a; ai 
a- E 



a- £ 



°- E 



<u ai 
a- E 



E E 
aj ai 
a- E 



a- £ 



EE £E ££ EE £ E £ E 



a- E 



2 o 21 o 2 o 2 o 2 o 

1— l/l I— L/l I— L/l Ho H m 
<_trvi l_) rN u in U in i_)(N 



a- E 
\— o 



a; ai 
a- £ 



a- £ 



Q- £ 



<d ai 
a- E 



Zo 2o 2o 2o 



— 3 



E 

5? 



E 



E m 



C 2 



5 g O 
o -o ™ 



QJ 2j 



— — XI 



% % E £ q: 
I % 3 J & 



E == '*= 

°> <u => 

. Q. 

c <o o 

*T U D. 



a xs 



E 



5 
E 



o >, o >, 



t_*(N U in u in U in u r\i 



E 



E 



9= 77? 



c O 

■C Q. 

■£ c 

<U O 

ii E 



3 E ' 



u rN u in c u <n a 



— — o 



ai 2L, 



PLOS Medicine | www.plosmedicine.org 



13 



March 2014 | Volume 11 | Issue 3 | e1 001 61 9 



Impact of Pyrethroid Resistance on ITN Efficacy 

collectors of mosquitoes or the sleepers (Table S8). Forty-eight of 
the 56 comparisons reported raw data for ITN and UTN groups. 
It was unclear in 16 comparisons as to whether nets were 
randomly allocated to huts at the start of the study. Overall, 41 
comparisons rotated ITNs, eight did not, and seven did not report 
rotation. Fifty comparisons rotated sleepers, whilst it was unclear 
as to whether the remaining comparisons rotated the sleepers 
between huts. 

Table 10 displays the rigor of implementation assessment of 
each hut trial in terms of particular study design characteristics. 
Standardisation across studies both in terms of the experimental 
design and reporting was not consistent. Of the 16 comparisons 
that compared a washed net, 12 washed the net in accordance 
with the WHO protocol, one did not wash the net using WHO 
procedures, and it was unclear whether the remaining three had 
followed WHO procedures. Seven of the 56 comparisons cleaned 
the huts before the study, whereas 25 comparisons cleaned the 
huts after each rotation; the remaining comparisons were unclear 
regarding when the huts were cleaned. Overall, 38 of the 56 
comparisons tested the ITNs before the study, 32 comparisons 
tested the ITNs on completion of the study, and 22 comparisons 
tested the nets chemically; the remaining comparisons did not test 
the nets. Outcomes were not measured on male mosquitoes in 30 
of the 56 comparisons, but were measured in the remaining 26 
comparisons. 

Characterisation of resistance was not consistent across studies. 
Seventeen comparisons measured phenotypic resistance using 
bioassays complemented with kdr genotyping in the mosquito 
populations under investigation. Bioassays on their own were used 
in 27 comparisons, whilst 1 1 comparisons were performed on 
mosquitoes for which only kdr genotyping was used. Characterisa- 
tion of metabolic resistance was reported in just two studies, where 
the authors also measured phenotypic resistance and kdr. For those 
studies which screened for kdr, ten stated the number of 
mosquitoes that had been genotyped. 

Relationship between Resistance and Entomological 
Outcomes 

Cone tests. Forty-seven cone test comparisons reported 
mosquito mortality (2 1 low, 20 moderate, and five high resistance 
and one unclear) (Figure SI). Mortality was very low in the 
untreated net group, and the risk of mosquito mortality is much 
higher using ITNs as compared with UTNs regardless of 
resistance. The study-specific RDs showed huge variability within 
all three categories of resistance. The meta-analytic results showed 
that the difference in mortality risk using ITNs as compared with 
UTNs decreased as resistance increased. Nevertheless, mortality 
risk was significantly higher for ITNs compared to UTNs 
regardless of resistance: with low resistance, the difference in risk 
of mortality is 0.86 (95% CI 0.72 to 1.01; 4,626 mosquitoes, 21 
comparisons; f= 100%, 95% CI 100% to 100%); in the case of 
moderate resistance the difference in risk is 0.71 (95% CI 0.53 to 
0.88; 5,760 mosquitoes, 20 comparisons; 7 2 =100%, 95% CI 
100% to 100%); with high resistance, the difference in risk is 0.56 
(95% CI 0. 1 7 to 0.95; 784 mosquitoes, five comparisons; / = 99%, 
95% CI 99% to 100%). The test for subgroup differences did not 
demonstrate a difference in the RD between high, medium, and 
low resistance subgroups (p = 0.1 2, / = 49%, 95% CI 23% to 
66%). A further 12 comparisons (seven low resistance, five high) 
presented data that could not be combined in meta-analysis 
(Table 11). 

Nine comparisons reported percentage knock-down at 60 min 
(six low resistance, two high, one unclear; Figure S2). In 
mosquitoes with low resistance, the risk of being knocked down 
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ITN 




UTN 






Risk Difference 


Stud or Sub 




Total 


Events 


Total 


Weight 


M-H Random 95% CI 


M-H, Random, 95% CI 


1 1 ll™ resistance 


















Chandre 2000 (Kisumu)a 


[2 9] 0 


107 


1 1 


63 


5.0% 


-0.17 [-0 27, -0 08) 






Chandre 2000 (Kisumu)b 


2 


1 48 


1 1 


63 


5 .0% 


-0.16 [-0.26, -0 07] 






Corbel 2010 (Benin)a 


[31] 9 


243 


2 1 


57 


4.8% 


-0.33 [-0.46, -0.20] 






Corbel 2010 (Benin)b 


12 


195 


21 


57 


4.8% 


-0.31 [-0.44, -0.18] 






Corbel 2010 (Benin)c 


1 


214 


21 


57 


4.8% 


-0.36 [-0.49, -0.24] 






Corbel 2010 (Benin)d 


26 


210 


21 


57 


4.8% 


-0.24 [-0.38, -0.11] 






Corbel 2010 (Benin)e 


31 


297 


21 


57 


4 .8% 


-0.26 [-0.39, -0.13] 






Darriet 2000 


[33] „-> 
82 


553 


335 


1 998 


5.2% 


-0.02 [-0.05, 0.01] 






Malima 2008 (funestus)a 


[36] 36 


222 


5 1 


1 53 


5.0% 


-0.16 [-0.25, -0.07] 


■ 




Malima 2008 (funestus)b 


21 


21 1 


5 1 


1 58 


5.1% 


-0.22 [-0.31, -0.14] 


■ 




Malima 2008 (gambiae)a 


28 


1 77 


1 5 


56 


4.8% 


-0.1 1 [-0.24, 0.02] 






Malima 2008 (gambiae)b 


8 


93 


1 5 


56 


4 .8% 


-0.18 [-0.31, -0.05] 






Malima 2009 (funestus) 


33 


327 






5.1 % 


-0.35 [-0-42, -0.28] 






Malima 2009 (gambiae) 


L 1 1 04 


740 


26 


493 


5.2% 


-0.12 [-0.17, -0.07] 


■ 




N'Guessan 2007 (M.ville) 


[38] R 

L ' 8 


267 


282 


363 


5.2% 


-0.75 [-0.79, -0.70] 






Tungu 2010a 


I«] 59 


574 


40 


145 


5.1% 


-U.I I [-U.25, -U.1UJ 






Tungu 2010b 


54 


586 


40 


145 


5.1% 


-0.18 [-0.26, -0.1 1] 


m 




Tungu 2010c 


11 


425 




145 


5.1% 


-0.25 [-0.32, -0.18] 






Tungu 2010d 


58 


558 


40 


145 


5.1% 


-0.17 [-0.25, -0.09] 






Tungu 2010e 


59 


560 


40 


145 


5.1% 


-0.17 [-0.25, -0.09] 






Subtotal (95% CI) 




6707 




4688 


100.0% 


-0 24 [-0 34 -0 1 4] 






Total events 


642 




1 326 












Heterogeneity: Tau 2 = 0.05; 


Chi 2 = 668.97, df 


- 1 9 (p < 


0.00001); I 2 = 97% 








Test for overall effect: Z = 4.60 (P < 0.00001 ) 














1.1.2 Moderate resistance 


















Corbel 2004a 


[30] 27 


60 




260 


11.0% 


-0.24 [-0.38, -0.10] 






Corbel 2004b 


26 


56 


1 79 


260 


10.6% 


-0.22 [-0.37, -0.08] 


■ 




Corbel 2010 (Cameroon )a 


[31] 16 


105 


42 


80 


11.9% 


-0.37 [-0.50, -0.24] 






Corbel 2010 (Cameroon)b 


63 


310 


42 


80 


13.1% 


-0.32 [-0.44, -0.20] 






Corbel 2010 (Cameroon )c 


41 


I 46 


42 


80 


11.6% 


-0.24 [-0.38, -0.1 1] 






Corbel 2010 (Cameroon )d 


40 


163 


42 


80 


12.0% 


-0.28 [-0.41, -0.15] 


. 




Corbel 2010 (Cameroon )e 


162 


565 


42 


80 


13.4% 


-0.24 [-0.35, -0.12] 






Oxborough 2013 


[49] 13 


1 1 0 


34 


143 


16.4% 


-0.12 [-0.21, -0.03] 


—m— 




Subtotal (95% CI) 




1515 




1063 


100.0% 


-0.25 [-0.31, -0.19] 


♦ 




Total events 


388 




602 












Heterogeneity: Tau 2 = O.OO; 


Chi 2 = 13.02, df = 


7 (P = 0.07); I 2 = 


46% 95% CI [0-76%) 






Test for overall effect: Z = 8.28 (P < 0.00001 ) 














1.1.3 High resistance 


[28] Q 
















Asidi 2005a 


34 


16 


42 


5.7% 


-0.38 [-0.53, -0.23] 


. 




Asidi 2005b 


4 


24 


16 


42 


5.0% 


-0.21 [-0.42, -0.01] 






Chandre 2000 (YFO)a 


[29] 5 


198 


36 


124 


6.5% 


-0.27 [-0.35, -0.18] 


-■- 




Chandre2000 (YFO)b 


17 


210 


36 


124 


6.4% 


-0.21 [-0.30, -0.12] 


— ■— 




Corbel 2010 (BFaso)a 


[31] 116 


329 


137 


182 


6.5% 


-0.40 [-0.48, -0.32] 


— ^ 




Corbel 2010 (BFaso)b 


382 


788 


137 


182 


6.6% 


-0.27 [-0.34, -0.20] 


■ 




Corbel 2010 (BFaso)c 


96 


463 


1 37 


1 82 


6.6% 


-0.55 [-0.62, -0.47] 






Corbel 2010 (BFaso)d 


263 


724 


137 


182 


6.6% 


-0 39 [-0.46, -0.32] 






Corbel 2010 (BFaso)e 


522 


1056 


137 


182 


6.6% 


-0.26 [-0.33, -0.19] 






Darriet 1998a 


[32] 63 


211 


127 


187 


6.4% 


-0.38 [-0.47, -0.29] 






Darriet 1998b 


95 

[3Sl 106 


307 


127 


187 


6.5% 


-0.37 [-0.45, -0.29] 






Fanello 1999a 


378 


32 


75 


6.1% 


-0.15 [-0.27, -0.03] 






Fanello 1999b 


74 


140 


32 


75 


5.9% 


0.10 [-0.04, 0.24] 






N'Guessan 2007 (Cotonou) 


( 38 l 317 


386 


565 


689 


6.7% 


0.00 [-0.05, 0.05] 






Ngufor2011 (6 holes) 


[39] n 


91 


44 


78 


6.0% 


-0.44 [-0.57. -0.31] 






Ngufor2011 (80 holes) 


35 


1 10 


80 


147 


6.1% 


-0.23 [-0.34, -0.11] 






Subtotal (95% CI) 




5449 




2680 


100.0% 


-0.28 [-0.37, -0.19] 






Total events 

Heterogeneity: Tau 2 = 0.03; 


2106 
Chi 2 = 253. 


9, df 


1796 
= 15 (P < 


0.00001); I 2 = 94% 


95% CI [92-96%] 






Test for overall effect: Z = 6.03 (P < 0.00001 ) 










1 1 


1 1 
















-0.5 -0.25 i 


) 0.25 0.5 


Test for subarouo differences: Chi 2 - 0.39. df - 


= 2 (P = 0.82). I 2 


= 0% 




Favours ITN 


Favours UTN 



Figure 2. Forest plot for experimental hut trials comparing LLIN or CTN versus UTN for blood feeding. BFaso, Burkina Faso; M-H, 

Mantel-Haenszel; M.ville, Malanville (Benin); YF0, Yaokoffikro, (Cote d'lvoire). 

doi:10.1371/journal.pmed.1001619.g002 
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ITN UTN Risk Difference Risk Difference 



Study or Subgroup 


Events 


T ° tal 


Eve tits 


— Total 


Woiy lit 


Ptfl-H, Random, 95% CI 


M-H, Random, 95% CI 


1.2.1 Low resistance 


















Chandre 2000 (Kisumu)a 


[29] 97 


107 


4 


63 


4.1% 


0.84 [0.76, 0.92] 






Chandre 2000 (Kisumu)b 


140 


148 


4 


83 


4.2% 


O.88 [0.81, 0.95] 






Corbel 2010 (Benin)a 


[31] 216 


243 


2 


5," 


4.2% 


0.85 [0.79, 0.92] 






Corbel 2010 (Benin)b 


138 


195 


2 


57 


4.1% 


0.67 [0.59, 0.75] 






Corbel 2010 (Benin)c 


207 


214 


2 


57 


4.2% 


O 93 [0.88. 0.99] 






Corbel 2010 (Benin)d 


147 


210 


2 


57 


4.1% 


O.66 [0.59, 0.74] 






Corbel 2010 (Benin)e 




297 


2 


57 


4.1% 


0.58 [0.50, 0.65] 






Darriet 2000 


245 


553 


192 


1 998 


4.2% 


0.35 [0.30, 0.39] 






Malima 2008 (funestus)a 


l 3 °J 164 


222 


13 


158 


4.2% 


O.66 [0.58, 0.73] 






Malima 2008 (funestus)b 


149 


211 


13 


158 


4.1% 


O.G2 [0.55, 0.70] 






Malima 2008 (gambiae)a 


1 1 -1 


177 


2 


56 


4.1% 


0.59 [0.51, 0.68] 






Malima 2008 (gambiae)b 


67 


93 


2 


56 


4.1 % 


0.68 [0.58. 0.79] 




— . — 


N'Guessan 2007 (M.ville) 


[38] 263 


267 


1 3 


363 


4.2% 


0.95 [0.93, 0.97] 






Okumu 2013 (dry season)a 


[91 

11 709 


6047 


134 


1 532 


4-2% 


0.03 [0.01, 0.05] 






Okumu 2013 (dry season)b 


844 


4420 


134 


1 532 


4.2% 


0-10 [0.09, 0.12] 




m 


Okumu 2013 (dry season)c 


1 028 


6492 


134 


1 532 


4.2% 


0.07 [0.05, 0.09] 




a 


Okumu 2013 (wet season)a 


1 742 


9789 


323 


2394 


4.2% 


0.04 [0.03, 0.06] 






Okumu 2013 (wet season)b 


1 644 


8240 


323 


2394 


4-2% 


O 06 [0.05, 0.08] 






Okumu 2013 (wet season)c 


2121 


1 1 279 


323 


2394 


4.2% 


O 05 [0.04, 0.07] 




■ 


Tungu 2010a 


[«] 548 


574 


22 


145 


4.2% 


O.SO [0.74, 0.86] 






Tungu 2010b 


510 


58tt 


'2.9. 


145 


4.2% 


0.72 [0.65, 0.78] 






Tungu 2010c 


407 


425 


22 


145 


4.2% 


0.81 [0.74, 0.87] 






Tungu 2010d 


531 


558 


22 


145 


4.2% 


O-SO [0.74, O.86] 






Tungu 2010e 


411 


560 


22 


145 


4.2% 


0.58 [0.51, 0.65] 






Subtotal (95% CI) 




51907 




15703 


100.0% 


0.5G [0.43, 0.68] 






Total events 


12621 




1734 












Heterogeneity: Tau 3 = 0.10; 


Chi 3 = 9859 56, df = 


= 23 (P < 


0.00001 ); ] 2 = 100% 








Test for overall effect: Z = 8.43 (P < 0.00001 ) 














1.2.2 Moderate resistance 


















Corbel 2004a 


[30] 10 


60 


71 


260 


12.4% 


-0.1 1 [-0.22, 0.00] 






Corbel 2004b 


14 


56 


71 


260 


12.3% 


-0.02 [-0.15, 0.10] 






Corbel 2010 (Cameroon )a 


[31] 87 


105 


10 


80 


1 2.5% 


0.70 [0.60, 0.81] 




- 


Corbel 2010 (Cameroon)b 


175 


310 


IO 


80 


12.6% 


0.44 [0.35, 0.53] 




■ 


Corbel 2010 (Cameroon )c 


137 


146 


10 


80 


12.6% 


0.81 [0.73. 0.90] 






Corbel 2O10 (Cameroon)d 


127 


163 


10 


80 


1 2.5% 


0.65 [0.56, 0.75] 






Corbel 2010 (Cameroon)e 


237 


5G5 


10 


80 


12.6% 


0.29 [0.21, 0.38] 






Oxborough 2013 


[49] 50 


110 


21 


143 


12.4% 


0.31 [0.20, 0.42] 




— m — 


Subtotal (95% CI) 




1515 




1063 


100.0% 


0.39 [0.16, 0.61] 






Total events 


837 




213 












Heterogeneity: Tau 2 = 0.10; 


Chi 2 = 297.62, df = 


7 (P < 0.00001 ); P 


= 98% 


95% CI [97-98%] 






Test for overall effect: Z = 3.36 {P = 0.0008) 














1.2.3 High resistance 


















Asidi 2005a 


[28] 23 


34 


5 


12 


3.9% 


0.56 [0.37, 0.74] 






Asidi 2005b 


18 


24 


5 


42 


3.8% 


0.63 [0.43, 0.83] 






Chandre 2000 (YFO)a 


[29] 107 


198 


5 


124 


4.8% 


0.50 [0.42, 0.58] 




_ 


Chandre2000 (YFO)b 


95 


210 


5 


124 


4.8% 


0.41 [0.34, 0.49] 




_ 


Corbel 2010 (BFaso)a 


[31] 146 


329 


g 


182 


4.9% 


0-39 [0.33, 0.46] 






Corbel 2010 (BFaso)b 


238 


788 


g 


182 


5.0% 


0.25 [0.21 . 0.30] 






Corbel 2010 (BFaso)c 


362 


463 


g 


182 


5.0% 


0.73 [O.68, 0.78] 






Corbel 2010 (BFaso)d 


357 


724 


9 


182 


5.0% 


0.44 [0.40, 0.49] 






Corbel 2010 (BFaso)e 


302 


1056 


g 


182 


5.0% 


0.24 [0.19, 0.28] 






Darriet 1998a 


[32] 118 


21 1 


8 


187 


4.9% 


0-52 [0.44, 0.59] 




_ 


Darriet 1998b 


123 


307 


8 


187 


4.9% 


0.36 [0.30, 0.42] 






Fanello 1 999a 


[35] 70 


378 


23 


75 


4.6% 


-0.12 [-0.23, -0.01] 


. 




Fanello 1 999b 


[42] 28 


140 


23 


75 


4.5% 


-0.1 1 I-0.23, 0.02] 






Koudou 201 1a 


1 1 166 


303 


11 


159 


4.9% 


0-48 [0.41, 0.55] 




_ 


Koudou 201 1b 


110 


317 


11 


1 59 


4.9% 


0.28 [0.21, 0.34] 






Koudou 201 1c 


100 


313 


11 


1 59 


4.9% 


0.25 [0.1 9, 0.32] 






Koudou 201 1d 


107 


281 


11 


159 


4.9% 


0.31 [0.24, 0.38] 






Koudou 201 1e 


110 


279 


11 


159 


4.9% 


0.33 [0.26, 0.39] 






N'Guessan 2007 (Cotonou) 


[38] 115 


366 


94 


689 


5.0% 


0.16 [0.11. 0.21] 






Ngufor 2011 (6 holes) 


[39] 45 


91 


4 


78 


4.6% 


0.44 [0.33, 0.56] 






Ngufor 20 1 1 (80 holes) 


41 


110 


5 


1 47 


4.7% 


0.34 [0.24, 0.43] 






Subtotal (95% CI) 




6942 




3475 


100.0% 


0.35 [0.27, 0.43] 




♦ 


Total events 


2781 




285 












Heterogeneity: Tau' = 0.03; 


Chi 2 = 553.99, df = 


20 (P <: 0.00001); 


2 = 96% 


95% CI [95-97%] 






Test for overall effect: Z = 8.82 (P < 0.00001 ) 








I 


1 


1 1 



H 
1 



Favours UTN Favours ITN 
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Figure 3. Forest plot for experimental hut trials comparing LLIN or CTN versus UTN for mosquito mortality. BFaso, Burkina Faso; M-H, 

Mantel-Haenszel; M.ville, Malanville (Benin); YF0, Yaokoffikro, (Cote d'lvoire). 

doi:10.1371/journal.pmed.1001619.g003 



PL0S Medicine | www.plosmedicine.org 



23 



March 2014 | Volume 11 | Issue 3 | e1 001 61 9 



Impact of Pyrethroid Resistance on ITN Efficacy 





ITN 




UTN 




Risk Difference 


Risk Difference 


Study or Subgroup Events 






Total 


w e 1 cj n t 


ivi-rt, Kanaom, S3 /o t-l 


M-H, Random, 95% CI 


1.3.1 Low resistance 


















Corbel 2010 (Benin)a 


149 


243 






4.6% 


0.19 [0.05, 0.33] 






Corbel 2010 (Benin)b 


117 


195 


24 


57 


4.5% 


0.18 [0.03, 0.32] 






Corbel 2010 (Benin)c 


113 


214 






4.5% 


0.11 [-0.04, 0.25] 






Corbel 2010 (Benin)d 


142 


210 






4.5% 


0.26 [0.1 1, 0.40] 






Corbel 2010 (Benin)e 


169 


297 






4.6% 


0.15 [0.01, 0.29] 






Darriet 2000 [33] 


370 


553 


637 


1998 


6.2% 


0.35 [0.31 , 0.39] 






Malima 2008 (funestus)a [36] 


206 


222 






6.0% 


0.02 [-0.04, 0.07] 






Malima 2008 (funestus)b 


210 


21 1 






6 2% 


0.08 [0.04, 0.13] 






Malima 2008 (gambiae)a 


1 7-i 


177 






5.7% 


0.07 [-0.00, 0.15] 






ivianma zuuo \yarnuiaeju 




93 


51 


56 


5.6% 


0.04 [-0.05, 0.12] 






IVI cJ 1 1 1 1 l(J i l/V \ It 1 1 1 C ri [ LJ b J 


307 


327 


219 


270 


6.1% 


0.13 [0.07, 0.18] 






Malima 2009 (gambiae) [37] 


688 


740 


434 


493 


6.3% 


0.05 [0.02, 0.08] 






N'Guessan 2007 (M.ville) (38] 


125 


267 






5.7% 


0.11 [0.03, 0.18] 






Tungu 2010a l 4 l] 


491 


574 




145 


5.9% 


0.00 [-0.06, 0.06] 






Tungu 2010b 


518 


586 


124 


145 


5.9% 


0.03 [-0.03, 0.09] 






Tungu 2010c 


335 


425 


124 


145 


5.8% 


-0.07 [-0.14, 0.00] 






Tungu 201 Od 


474 


558 


124 


145 


5.9% 


-0.01 [-0.07, 0.06] 






Tungu 2010e 


515 


560 




145 


6 0% 


0.06 [0.00, 0.13] 






Subtotal (95% CI) 




6452 




4562 


100.0% 






♦ 


Total events 5191 
















Heterogeneity: Tau 2 = 0.01; Chi 3 = 


217.87, df = 


17 (P< 


0 00001); I 2 = 92% 


QC0/ /~T fQQ Q/10/1 






Test for overall effect: Z = 3.20 (P 


= 0.001) 














1.3.2 Moderate resistance 


















Corbel 2004a I30] 


40 


60 


19 


260 


12.6% 


0.59 [0.47, 0.72] 




. 


Corbel 2004 b 


31 


56 


19 


260 


12.3% 


0.48 [0.35, 0.61] 






Corbel 2010 (Cameroon)a [31] 


65 


105 




80 


12.1% 


0.26 [0.12, 0.40] 






Corbel 2010 (Cameroon )b 


161 


310 


29 


80 


12.7% 


0.16 [0.04. 0.28] 




• 


Corbel 2010 (Cameroon )c 


85 


146 


29 


80 


12.3% 


0.22 [0.09, 0.35] 






Corbel 2010 (Cameroon )d 


84 


163 


29 


80 


12.4% 


0.15 [0.02, 0.28] 




• 


Corbel 2010 (Cameroon)e 


337 


565 


29 


80 


12.9% 


0.23 [0.12, 0.35] 






Oxborough 2013 [49] 


84 


110 


87 


143 


12.9% 


0.16 [0.04, 0.27] 




1 


Subtotal (95% CI) 




1515 




1063 


100.0% 


n ott rn 17 n <ini 






Total events 


887 




270 












Heterogeneity; Tau 2 = 0.02; Chi 2 - 


47.48. df = 7 (P < 0.00001 ); 


I 2 = 85% 


n f73-Q?%l 

jj/o Li l / j jz. /oj 






Test for overall effect: Z = 4.78 (P 


< 0.00001) 














1.3.3 High resistance 

[28] 

Asidi 2005a 


20 


34 


18 


42 


4.1% 


0.16 [-0.06, 0.38] 






Asidi 2005b 


14 


24 


18 


42 


3.7% 


0.15 [-0.09. 0.40] 






Corbel 2010 (BFaso)a [31] 


265 


329 


58 


182 


6.3% 


0.49 [0.41 , 0.57] 




» 


Corbel 2010 (BFaso)b 


533 


788 


58 


182 


6.3% 


0.36 [0.28, 0.43] 






Corbel 2010 (BFaso)c 


369 


463 


58 


182 


6.3% 


0.48 [0.40. 0.56] 




—w— 


Corbel 2010(BFaso)d 


548 


724 


58 


182 


6.3% 


0.44 [0.36, 0.51] 






Corbel 2010 (BFaso)e 


635 


1056 


58 


182 


6.4% 


0.28 [0.21 , 0.36] 






Darriet 1998a [32] 


93 


211 


45 


187 


6.1% 


0.20 [0.11, 0.29] 




— . 


Darriet 1998b 

Koudou2011a ' 42 l 


132 
154 


307 
303 


45 
54 


187 
159 


6.2% 
6.1% 


0.19 [0.11, 0.27] 
0.17 [0.08, 0.26] 




. 

, 


Koudou 201 1 b 


186 


317 


54 


159 


6.1% 


0.25 [0.16, 0.34] 




— w — 


Koudou 201 1c 


157 


313 


54 


159 


6.1% 


0.16 [0.07. 0.25] 




— . 


Koudou 201 1 d 


166 


281 


54 


159 


6.1% 


0.25 [0.16. 0.34] 






Koudou 201 1 e 


146 


279 


54 


159 


6.1% 


0.18 [0.09, 0.28] 






N'Guessan 2007 (Cotonou)[38] 


112 


386 


172 


689 


6.5% 


0.04 [-0.02. 0.10] 






Ngufor 201 1 (6 holes) l 39 l 


64 


91 


37 


78 


5.3% 


0.23 [0.08, 0.37] 






Ngufor2011 (80 holes) 


75 


110 


58 


147 


5.8% 


0.29 [0.17, 0.40] 






Subtotal (95% CI) 




6016 




3077 


100.0% 


0.26 [0.19, 0.33] 




♦ 


Total events 3669 




953 












Heterogeneity: Tau 2 = 0.02; Chi 2 = 


167.40, df = 


16 (P < 


0.00001 ); I 2 ■ 90% 


95% a [86-93%] 






Test for overall effect: Z = 7.1 1 (P 


< 0 00001) 




























1 1 

-0.5 -0.25 ( 


1 1 

) 0.25 0.5 


Test for subgroup differences: Ch 


2 = 16.76, df 


= 2 (P = 


0.0002), I 2 =88.1°/ 


95% CI [81.63. 92.29] 


Favours UTN 


Favours ITN 



Figure 4. Forest plot for experimental hut trials comparing LLIN or CTN versus UTN for induced exophily. BFaso, Burkina Faso; M-H, 
Mantel-Haenszel; M.ville, Malanville (Benin); YFO, Yaokoffikro, (Cote d'lvoire). 
doi:1 0.1 371/journal.pmed,1 001 61 9.g004 
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is significantly higher using ITNs as compared with UTNs, but 
with high resistance, there is no difference between ITNs and 
UTNs. A significant difference is detected between the meta- 
analytic results for mosquitoes with low, unclear, and high 
resistance (£<0.00001, 7 2 = 98.8%, 95% CI 98.3% to 99.2%). 

The majority of studies show that the risk of knock-down is 
higher using ITNs than using UTNs, regardless of resistance. In 
mosquitoes with low resistance, the difference in risk of knock- 
down is 0.87 (95% CI 0.69 to 1.05; 3,440 mosquitoes, 17 
comparisons; 7 2 =100%, 95% CI 100% to 100%); with high 
resistance, the difference in risk is 0.09 (95% CI -0.03 to 0.21; 
309 mosquitoes, two comparisons; 7 2 = 87%, 95% CI 94% to 
97%). There is high variability between the results from studies 
within the same resistance category, although all comparisons tend 
to favour ITNs. A further 12 comparisons (seven low resistance, 
five high) presented data that could not be combined in meta- 
analysis (Table 11). 

Seven cone test comparisons reported time to 50% knock-down 
(four low resistance, three high), and two comparisons presented 
time to 95% knock-down (one low, one high). By visual inspection 
of Table 5, the knock-down times tend to be longer in studies of 
mosquitoes with high resistance than in studies of mosquitoes with 
low resistance. However, this comparison is made across trials and 
may be subject to confounding. 

Tunnel tests. Fourteen tunnel test comparisons reported 
feeding (eight low resistance, two moderate, six high) (Figure S3). 
The higher the resistance, the lower the effectiveness of ITNs (as 
compared with UTNs). A significant difference is detected 
between the meta-analytic results for mosquitoes with low, 
moderate, and high resistance (£ = 0.001, 7 2 = 85.1%, 95% CI 
68.7% to 92.9%). A lower risk of blood feeding is apparent when 
using ITNs as compared with UTNs, regardless of resistance. For 
mosquitoes with low resistance, the difference in the risk of blood 
feeding is -0.66 (95% CI -0.77 to -0.55; 2,177 mosquitoes, 
eight comparisons; J 2 = 92%, 95% CI 87% to 95%); for 
mosquitoes with moderate resistance, the difference in risk is 
-0.53 (95% CI -0.63 to -0.42; 300 mosquitoes, two compar- 
isons; J 2 = 0% 95% CI not estimable); and for mosquitoes with 
high resistance, the difference in risk is —0.27 (95% CI —0.45 to 
-0.09; 2,472 mosquitoes, six comparisons; I 2 = 97%, 95% CI 
94% to 98%). There is high variability among the results from 
studies of mosquitoes with low resistance and also among those 
from studies of mosquitoes with high resistance, although most 
comparisons significantly favour ITNs. Four additional compar- 
isons (low resistance) presented data that could not be combined in 
meta-analysis (Table 6). 

Sixteen tunnel test comparisons reported mosquito mortality 
(eight low resistance, two moderate, six high) (Figure S4). The risk 
of mortality is significantly higher using ITNs as compared with 
UTNs, regardless of resistance. The meta-analytic results showed 
that the difference in mortality risk using ITNs as compared with 
UTNs decreased as resistance increased. The test for subgroup 
differences showed significant variability between the meta- 
analytic results from low, moderate, and high resistance subgroups 
(£ = 0.001, 7 2 = 84.7%, 95% CI 67.9% to 92.7%). For mosquitoes 
with low resistance, the difference in risk is 0.74 (95% CI 0.61 to 
0.87; 2,177 mosquitoes, eight comparisons; 7 2 = 96%, 95% CI 
94% to 97%); for mosquitoes with moderate resistance, the 
difference in risk is 0.50 (95% CI 0.40 to 0.60; 300 mosquitoes, 
two comparisons; 7 2 =11%, 95% CI not estimable); and for 
mosquitoes with high resistance, the difference in risk is 0.39 (95% 
CI 0.24 to 0.54; 2,472 mosquitoes, six comparisons; 7 2 = 95%, 
95% CI 94% to 98%). There is high variability among the results 
from studies of mosquitoes with low resistance and also among 



those from studies of mosquitoes with high resistance, yet almost 
all comparisons significandy favour ITNs. Table 6 shows the 
results of additional comparisons (low resistance) that could not be 
combined in meta-analysis. 

Six tunnel test comparisons reported whether mosquitoes could 
not pass through the net (four low resistance, two high) (Figure S5). 
Results show that the higher the resistance, the lower the effectiveness 
of ITNs (as compared with UTNs). The observed trend could be 
caused by differences in characteristics (other than resistance) 
between the studies of low resistance mosquitoes and those of high 
resistance mosquitoes. A significant difference is detected between the 
meta-analytic results for low and high resistance mosquitoes (£< 
0.00001, / = 98.4%, 95% CI 97.1% to 99.1%). 

The risk of not passing though the net is significantly higher 
when using ITNs than when using UTNs, regardless of mosquito 
resistance. In mosquitoes with low resistance, the difference in risk 
is 0.68 (95% CI 0.62 to 0.75; 1,140 mosquitoes, four comparisons; 
7 2 = 61%, 95% CI 0% to 87%), and in mosquitoes with high 
resistance, the difference in risk is 0.36 (95% CI 0.31 to 0.41; 1,309 
mosquitoes, two comparisons; 7 2 = 0%, 95% CI not estimable). 
There is variability among the results from studies of mosquitoes 
with low resistance, yet all comparisons significantly favour ITNs. 
Four additional comparisons (low resistance) presented data that 
could not be combined in meta-analysis (Table 6). 

Experimental hut trials. Overall, 44 hut trial comparisons 
reported blood feeding (20 low resistance, nine moderate, 15 high) 
(Figure 2). There is no clear relationship between resistance and 
the effectiveness of ITNs. A significant difference is not detected 
between the meta-analytic results for low, moderate, and high 
resistance groups (£ = 0.84, 7 2 = 0%, 95% CI 0% to 35%). 

Blood feeding was reduced when using ITNs as compared with 
UTNs, regardless of resistance. In mosquitoes with low resistance, 
the difference in the risk of blood feeding is -0.24 (95% CI -0.34 
to -0.14; 11,395 mosquitoes, 20 comparisons; 7 2 = 97%, 95% CI 
96% to 98%); in mosquitoes with moderate resistance, the 
difference in risk is -0.25 (95% CI -0.31 to -0.19; 2,578 
mosquitoes, eight comparisons; 7 2 = 46%, 95% CI 0% to 76%); 
and in mosquitoes with high resistance, the difference in risk is 
-0.28 (95% CI -0.37 to -0.19; 8,129 mosquitoes, 16 compar- 
isons; / = 94%, 95% CI 92% to 96%). There is particularly high 
variability among the results from studies of mosquitoes with low 
resistance and among those from studies of mosquitoes with high 
resistance, although most comparisons significantly favour ITNs. 
One comparison [22], with high resistance, reported 38% and 68% 
blood feeding (figures estimated from graph) in the ITN and UTN 
groups, respectively (RD = 0.3). 

Fifty-three hut trial comparisons reported mosquito mortality 
(24 low resistance, eight moderate, 20 high) (Figure 3). There is 
high heterogeneity across study-specific results with each category 
of resistance. In addition, one study [9] appears to show no 
evidence of an effect of ITNs in low resistance mosquitoes. The 
authors also report on the bioassay, which shows 90%-100% 
susceptibility to insecticides. However, mortality risk was higher 
for ITNs compared to UTNs irrespective of the resistance 
category. In mosquitoes with low resistance, the difference in risk 
is 0.56 (95% CI 0.43 to 0.68; 67,610 mosquitoes, 24 comparisons; 
f= 100%, 95% CI 100% to 100%); in mosquitoes with moderate 
resistance, the difference in risk is 0. 39 (95% CI 0.16 to 0.61; 
2,578 mosquitoes, eight comparisons; 7 2 = 98%, 95% CI 97% to 
98%); and with high resistance, the difference in risk is 0.35 (95% 
CI 0.27 to 0.43; 10,417 mosquitoes, 21 comparisons; f = 96%, 
95% CI 95% to 97%). The meta-analytic results showed that the 
difference in mortality risk using ITNs as compared with UTNs 
modestly decreased as resistance increased, and the test for 
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subgroup differences demonstrated a difference in the RD 
between high, medium, and low resistance subgroups (p = 0.03, 
f = 72.0%, 95% CI 58.7% to 81.0%). 

One comparison [22], with high resistance mosquitoes, reported 
42% and 2% mortality (figures estimated from graph) in the ITN 
and UTN groups, respectively (RD = 0.4). 

Forty-three trial hut comparisons reported results for induced 
exophily (18 low resistance, nine moderate, 16 high) (Figure 4). 
There is no clear relationship between resistance and the 
effectiveness of ITNs in relation to this outcome. A significant 
difference is detected between the meta-analytic results for low, 
moderate, and high resistance (p = 0.0002, 7 2 = 88.2%, 95% CI 
81.6% to 92.3%). 

Generally, the risk of exiting the hut is higher using ITNs than 
using UTNs, regardless of resistance. For mosquitoes with low 
resistance, the difference in risk is 0.09 (95% CI 0.04 to 0.15; 
11,014 mosquitoes, 18 comparisons; 7 2 = 92%, 95% CI 89% to 
94%); for mosquitoes with moderate resistance, the difference in 
risk is 0.28 (95% CI 0.17 to 0.40; 2,578 mosquitoes, eight 
comparisons; f = 85%, 95% CI 73% to 92%); and for mosquitoes 
with high resistance, the difference in risk is 0.26 (95% CI 0.19 to 
0.33; 8,695 mosquitoes, 16 comparisons; 7 2 = 90%, 95% CI 86% 
to 93%). There is substantive heterogeneity within and across 
resistance groups, but most comparisons significandy favour ITNs. 
One comparison [22], with high resistance mosquitoes, reported 
80% and 20% induced exophily (figures estimated from graph) in 
the ITN and UTN groups, respectively (RD = 0.6). 

Fifty-five comparisons reported on deterrence (21 low resis- 
tance, 13 moderate, 21 high) (Table 12). There is no clear 
relationship between resistance status and deterrence based on a 
visual inspection of the results. 

Results of Subgroup Analyses, Sensitivity Analyses, and 
Funnel Plots 

Considerable heterogeneity was found across all studies, 
therefore sources of heterogeneity were explored using subgroup 
analyses. We carried out subgroup analyses by net type, insecticide 
used, the concentration of insecticide, and whether nets were 
washed or not. Because of the wide variation between studies in 
relation to these factors, these plots were numerous. We carried 
out analyses grouping in different ways, but these analyses did not 
provide any explanation of the heterogeneity between studies. The 
funnel plots do not resemble symmetric funnels; this may be 
because of the high level of variability between studies and the low 
quality of the evidence (see Figures S6-S13). For experimental hut 
trials, similar conclusions are drawn from the sensitivity analyses 
and primary analyses (Table S9; Figures SI 4— S20). 

Discussion 

The study set out to determine whether mosquito resistance to 
insecticides is having an impact on entomological outcomes in 
ITNs compared to UTNs in three experimental settings: highly 
controlled cone studies, laboratory tunnel studies with animal bait, 
and field trials in huts with humans as the attractant. Cone tests for 
mosquito knock-down showed reduced levels of knock-down 
associated with higher levels of resistance. Laboratory tunnel test 
results demonstrated a reduced effect of ITNs in mosquitoes with 
higher levels of resistance in terms of blood feeding, mosquito 
mortality, and passage through the nets. 

In experimental hut trials the RD for mortality for ITNs 
compared to UTNs showed that ITNs continued to have an effect 
in all categories of resistance. The meta-analytic results showed 
that the difference in mortality risk using ITNs as compared with 



UTNs modesdy decreased as resistance increased, and the test for 
subgroup differences demonstrated a difference in the RD 
between high, medium, and low resistance subgroups. The 
substantive heterogeneity in the studies' results and design may 
mask the true relationship between resistance and the RD, and the 
results need to be interpreted with caution. 

What is clear from the results is that ITNs continue to have a 
substantive effect compared to UTNs in many studies, and that 
despite best efforts, explaining the heterogeneity between studies 
has been problematic, with field studies showing quite varied 
results. Sometimes there are quite unexpected and inconsistent 
findings such as in the study by Okumu et al. [9], which shows no 
evidence of a benefit of insecticide despite bioassays indicating 
"sensitivity". Studies overall are very poor in characterising the 
resistance pattern of the mosquitoes, and the classification systems 
are unclear and lack uniformity. 

We observed a large amount of heterogeneity and bias across 
studies, which was particularly acute in the field studies. Variations 
in the wild mosquito populations — such as their resistance levels, 
age, blood feeding and mating status (factors that themselves could 
influence resistance levels and host-seeking behaviour) — and also 
the local environment cannot be controlled for across studies. In 
addition, the execution of the field trials was not uniform across 
the studies, e.g., washing of nets, rotation of nets/sleepers, season 
in which the trial took place, length of the trial, decontamination 
of huts, and exclusion of male mosquitoes from the analysis. Only 
one field trial conducted a direct comparison of susceptible versus 
resistant mosquitoes [29]. Deterrence could not be measured 
because the mosquitoes were directly placed inside the huts. For 
the remaining studies we conducted indirect comparisons between 
trials of nets in areas of high or moderate resistance and those in 
low resistance areas. Blinding of mosquito collectors, observers, 
and sleepers was not addressed in any of the studies. 

One area of concern is that assessment of resistance of mosquito 
populations is not optimised across studies, and hence misclassi- 
fication of resistance is likely to occur, adding to the high levels of 
heterogeneity. It is possible that target-site and metabolic 
resistance exert a differential impact on LLIN effectiveness, but 
most studies fail to accurately assess the presence of metabolic 
resistance. Insecticide resistance profiling of mosquito populations 
was varied across all studies, with just under half of the field studies 
measuring phenotypic resistance or kdr frequency, two out of the 
14 studies measuring both, and only one measuring phenotypic 
resistance, kdr, and metabolic resistance [50]. Phenotypic resis- 
tance, as measured by bioassays, is regarded as the first step in 
identifying resistance [51]. It is prudent to always carry out 
bioassays to establish resistance levels before implementing 
mechanistic studies (e.g., genotyping for target-site and metabolic 
resistance and biochemical assays). It is unwise to assume that kdr 
alone is solely responsible for the resistant phenotype [52,53]; 
mosquitoes could still harbour metabolic resistance, for example. 
Based on this, we were reluctant to label mosquito populations 
with no or low kdr frequency as "susceptible" (low resistance). 

It is becoming increasingly clear that metabolic resistance 
often underpins pyrethroid resistance in mosquitoes, as demon- 
strated by both gene expression studies of resistant populations 
[11,17,18,19,20,54] and enzyme characterisation studies [55,56]. 
To date, resistance has been directly implicated in operational 
control failure of pyrethroids only in An. funestus in South Africa 
[57]. Metabolic resistance is the underlying mechanism 
[54,58,59], and therefore this mosquito species offers a unique 
opportunity to measure the impact of resistance on ITN efficacy. 
Unfortunately, none of the included studies have included the 
resistant form of this species. 
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A large number of studies were excluded because the insecticide 
resistance status of the wild mosquito populations was not 
characterised at the time of the study, but rather relied upon 
retrospective data. Mosquito populations are dynamic, and 
although a kdr frequency of >0.90, which is close to fixation, is 
unlikely to revert rapidly, we cannot rule out the migration of 
mosquito populations or other confounding factors that could 
dramatically influence mosquito populations and/or resistance 
profiles over time. 

In terms of interpreting the patterns, this has to be done with 
care, given the variability of the results. Reduced killing of 
mosquitoes with increasing resistance in tunnel and hut studies 
raises concerns. Feeding preferences of mosquitoes can be plastic 
[60] , and there is evidence that anthropogenic species such as An. 
gambiae and An.funestus can switch to feeding on cattle to obtain a 
blood meal in the presence of pyrethroid-treated materials [61,62]. 
So, although the personal protection properties of ITNs (i.e., 
prevention of blood feeding and induced exophily) are still 
maintained, there is still the risk that if different hosts are 
available, mosquitoes could adapt their feeding preferences and 
thereby maintain large population sizes. If LLIN coverage is 
lowered, nets become badly damaged, are inappropriately used, 
are sold on, or are used less over time (all of which are realistic 
scenarios) [63], the reduced killing of resistant mosquitoes, which 
may have obtained a blood meal elsewhere, could be a cause for 
concern. 

Inconsistency between studies in relation to study design, 
execution, and reporting format across all experimental hut trials 
is an obstacle in addressing the relationship between resistance and 
ITN efficacy confidently. There are no clear guidelines for 
measuring ITN efficacy against resistant mosquitoes. As a 
consequence, the studies do not easily lend themselves to meta- 
analysis, and so it is difficult to generate a consensus. It is likely 
that the effects of resistance on some outcomes may be moderate 
or small, but the lack of standardisation means the methodological 
differences between studies obscure any detection or coherent 
synthesis between studies. So, if this field of research aims to 
identify generalisable findings, then researchers need to consider 
how best to measure the dependent and independent variables so 
that the results are more comparable. Our concern with this lack 
of transparency and standardisation, and the need for improved 
reporting, echoes recent calls [64] for research to be better 
planned, co-ordinated, and of higher quality. With such gaps and 
lack of standardisation in the primary studies, it could be argued 
that current research represents inefficient use of scarce resources 
of the scientific community as a whole. 

Based on the studies included in this meta-analysis, ITNs 
remain at least somewhat effective against African anopheline 
mosquitoes even when resistance has developed. However, 
whether ITNs remain effective against resistant mosquitoes cannot 
be definitively addressed whilst the execution and reporting of field 
studies and the profiling of resistance in mosquito populations is 
inadequate and inconsistent. Ideally, phenotypic resistance, target- 
site resistance, and metabolic resistance testing should all be 
applied to mosquito populations in the vicinity of the hut trial. If 
this is not feasible, then a combination of either phenotypic and 
target-site resistance testing or target-site and metabolic resistance 
testing should be performed. Authors should make it clear in their 
reporting if they have omitted to test for any of the three categories 
of resistance highlighted above. It is also imperative that resistance 
is measured at the time of the study rather than relying on 
retrospective data. International agreement is needed for stan- 
dardised methods for measuring the impact of resistance on ITNs 
before conclusive statements about the effect of resistance can be 



made. In order to initiate dialogue about the standardisation of 
methods and reporting we have generated a list of criteria that 
need to be addressed based on the experience of this review (Box 
2). It is important that policy makers and non-governmental 
organizations plan vector control strategies and purchase ITNs 
based on the best available data. 
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Editors' Summary 

Background. Every year more than 200 million cases of 
malaria occur worldwide, and more than 600,000 people, 
mostly children living in sub-Saharan Africa, die from this 
parasitic infection. Malaria is transmitted to people through 
the bites of night-flying mosquitoes. Soon after entering the 
human body, the parasite begins to replicate in red blood 
cells, bursting out every 2-3 days and infecting more red 
blood cells. The presence of the parasite in the bloodstream 
causes malaria's recurring flu-like symptoms, which need to 
be treated promptly with antimalarial drugs to prevent 
anemia (a reduction in red blood cell numbers) and life- 
threatening organ damage. Malaria can be prevented by 
using insecticides to control the mosquitoes (vectors) that 
spread the parasite and by sleeping under insecticide- 
treated bed nets (ITNs) to avoid mosquito bites. High levels 
of ITN use reduce malaria-related deaths among children by 
about 20%. Consequently, the widespread provision of ITNs 
is a mainstay of global efforts to control malaria. 

Why Was This Study Done? About 50% of African 
households now possess an ITN. However, the emergence 
of resistance to pyrethroid insecticides — the insecticide class 
recommended by the World Health Organization for use in 
ITNs — in some mosquitoes potentially threatens the efficacy 
of ITNs. Pyrethroids kill Anopheles mosquitoes (the main 
malaria vectors in sub-Saharan Africa) but also prevent 
mosquitoes entering houses (deterrence), disrupt feeding, 
and encourage mosquitoes to leave homes prematurely 
("induced exophily"; Anopheles mosquitoes usually rest 
inside for a while after feeding). Worryingly, 27 countries in 
sub-Saharan Africa have already reported resistance to 
pyrethroids in Anopheles mosquitoes. In this systematic 
review and meta-analysis, the researchers assess the impact 
of pyrethroid resistance on the efficacy of ITNs against 
African anopheline mosquitoes in terms of entomological 
outcomes. A systematic review identifies all the research on a 
given topic using predefined criteria, meta-analysis uses 
statistical methods to combine the results of several studies, 
and entomological outcomes are measures of mosquito 
behavior and survival. 

What Did the Researchers Do and Find? The researchers 
identified 25 reports of laboratory and field studies of the 
impact of ITNs on African malaria vectors that measured the 
mosquitoes' resistance to pyrethroid insecticides at the time 
of the study. The laboratory studies used two assays to 
measure entomological outcomes. The cone test measured 
mosquito mortality (death), percent of mosquitoes knocked 
down (immobilized) after 60 minutes, and the time to knock 
down 50% or 95% of the mosquitoes after brief exposure to 
an ITN or untreated bed net (UTN). In the tunnel test, 
mosquitoes had to pass through a holed ITN or UTN to reach 
animal baits; counts of live and dead mosquitoes, and fed 
and unfed mosquitoes on both sides of the net measured 
deterrence, blood feeding, and mosquito mortality. In the 
field studies, volunteers slept under an ITN or UTN in an 
experimental hut. Subsequent counts of live and dead 
mosquitoes and fed and unfed mosquitoes inside the huts 



and in exit traps measured deterrence, blood feeding, 
mosquito mortality, and induced exophily. The researchers 
report that the measurement of insecticide resistance was 
inconsistent across the identified studies. Nevertheless, their 
analysis found that ITNs are more effective than UTNs in 
relation to mosquito mortality, regardless of resistance. 
There was a relationship between resistance and the risk 
difference for mosquito mortality in laboratory and field 
studies, but the substantive variation between studies means 
that the findings should be interpreted with caution. 

What Do These Findings Mean? These findings show 
that pyrethroid resistance clearly affects entomological 
outcomes in laboratory studies, and suggests that this 
pattern may also be observed in field trials. However, ITNs 
remained at least somewhat effective despite insecticide 
resistance in terms of personal protection. The researchers 
note that there was considerable variability (heterogeneity) 
among the results obtained in the field trials and suggest 
that poorly standardized methods and reporting might have 
masked the true relationship between insecticide resistance 
and ITN efficacy in these studies. Thus, although ITNs 
continue to have a substantive effect in many laboratory 
studies in the face of insecticide resistance, whether ITNs are 
likely to remain effective against insecticide-resistant mos- 
quitoes in the real world cannot be definitively concluded. 
Malaria experts and vector biologists need to work together 
to improve the quality of field trials and to standardize the 
measurement of insecticide resistance and entomological 
outcomes, suggest the researchers. Such collaborations, they 
conclude, are essential to provide the data that policy 
makers need to plan malaria control strategies. 

Additional Information. Please access these websites via 
the online version of this summary at http://dx.doi.org/10. 
1 371 /journal.pmed.1 001 61 9. 

• Information is available from the World Health Organiza- 
tion on malaria (in several languages); the World Malaria 
Report 2013 provides details of the current global malaria 
situation 

• Information is available from the World Health Organiza- 
tion on a call for action to tackle the growing threat of 
insecticide resistance and to facilitate the development of 
innovative vector control tools and strategies (in English, 
French and Spanish) 

• The US Centers for Disease Control and Prevention provide 
information on malaria (in English and Spanish) and on 
insecticide-treated bed nets; it also provides a selection of 
personal stories about malaria 

• Information is available from the Roll Back Malaria 
Partnership on the global control of malaria and on the 
Global Malaria Action Plan (in English and French); its 
website includes fact sheets about malaria in Africa and 
about insecticide-treated bed nets 

• MedlinePlus provides links to additional information on 
malaria (in English and Spanish) 
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